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ABSTRACT 

Let  Y  be  an  n- variate  random  vector  with  expectation  0  €  Rn  and 
covariance  matrix  V  €  (/,  where  V  is  assumed  to  be  a  closed  convex  cone 
of  non-negative  definite  matrices  of  order  n  x  n.  It  is  desired  to 
characterize  admissible  estimators  of  9  among  linear  estimators  LY, 
where  L  is  an  n  x  n  matrix.  The  main  result  states  that  in  the  case 
when  V  coincides  with  the  set  of  all  non-negative  definite  matrices  LY 
is  admissible  if  and  only  if  the  eigenvalues  of  L  are  in  the  closed  in¬ 
terval  [0,1].  Necessary  and  sufficient  conditions  for  admissibility  when 
1/  consists  of  positive  definite  matrices  are  also  given.  This  latter 
result  generalizes  the  well-known  theorem  of  Cohen  on  characterization  of 
admissible  linear  estimators  within  models  where  1/  is  generated  by  the 
unit  matrix. 
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1.1 


I.  THE  MODEL 

Let  Y  be  an  n-variate  random  vector  with  expectation  9  =  EY  and 
covariance  matrix  V  =  cov(Y) .  The  parameters  are  (9,V).  Denote  the 
parameter  space  by  P,  which  is  assumed  to  be  of  the  form  Rn  x  l/,  where 
V  is  a  closed  convex  cone  of  non-negative  definite  matrices. 

Call  LY,  where  L  is  an  n  x  n  matrix,  a  linear  estimator  of 
0  =  EY.  The  risk  function  used  is 

R(L|0,V)  =  E(LY  -  9) ' (LY  -  9),  (9,V)  G  P. 

LY  is  called  admissible  among  linear  estimators  if  no  other  linear 
estimator  is  better  than  LY  within  model  with  parameter  space  P. 

The  aim  of  this  paper  is  to  establish  necessary  and  sufficient  condi¬ 
tions  for  LY  to  be  admissible  under  the  above  quadratic  loss  function 
when  different  sets  of  restrictions  are  placed  on  I/. 

Throughout  the  paper  we  shall  use  the  following  notation: 

n.n.d.  *  non-negative  definite  (symmetric). 

p.d.  *  positive  definite  (symmetric). 

p.s.  =  parameter  space. 

[V]  =  the  closed  convex  cone  generated  by  n.n.d.  matrix  V. 

T  -  {(99',V):(9,V)  G  ?}. 

( T  ]  x  the  smallest  closed  convex  cone  containing  r. 

Note  that  ($,V)  G[f]  implies  that  $  and  V  are  n.n.d. 


Also  note  that  C$,0)  €  [  r  1  for  all  n.n.d.  matrices  $. 

Let  R(L|*,V)  =  trtL'LV  +  (L-I)  *  (L-I)$  1  for  ($,V)  €[!]. 

Note  that  R(L)9,V)  =  RCLjee’.V)  for  (9,V)  S  P. 

R(A)  =  linear  manifold  generated  by  the  columns  of  matrix  A. 
N(A)  =  [ RCA)]1  -  orthogonal  complement  of  RCA). 

A'  =  the  transpose  of  A. 

A+  =  the  Moore-Penrose  inverse  of  A. 

I  =  the  unit  matrix, 

tr  A  =  the  trace  of  A. 

A  >  B  denotes  A  -  B  is  n.n.d. 

A  >  B  denotes  A  -  B  is  p.d. 

5axb  *  space  a  x  b  matrices. 

Smxn  x  Saxb  “  Product  sPace* 

5axb  “  ^axb  x  ^axb' 

[  A,B  1  =  tr  AB' 

l^n  =  the  set  of  all  n.n.d.  matrices  of  order  n  x  n. 


II.  SOME  USEFUL  LENMAS 


Lenrna  2.1. 

Let  V  be  an  n.n.d.  matrix  of  order  n  x  n  and  of  rank  r  >1.  Let 
A  be  any  symmetric  matrix  such  that  AV  is  symnetric.  Then  A  has  r 
eigenvectors,  say,  Plt...,P  ,  such  that 


r 

V  =■  Z 
i»l 


TiPiPi 


9 


where  ^>0,  i*l,...,r. 

Proof. 

(i)  First  suppose  that  V  is  p.d.  If  AV  is  symnetric,  then 
W  ■  V  **  AV5*  is  also  symnetric.  In  fact, 

W'  -  V31  A*  V'h  *  V'3*  VA'V'3*  *  V'35  (AV)  'V'3*  »  V'3*  AW'3*  *  V'3*  AV3*  =  W. 

Let  Xp...,  Xn  be  the  eigenvalues  of  W,  and  let  Qp*-->Qn  be 
normalized  orthogonal  eigenvectors  of  W  with  eigenvalues  Xp  • .  • ,  xn» 
respectively.  Thus  WQi  »  x^,  i«l,...,n.  For  i*l,...,n  let 

Pi  -  V*  Qi- 

Note  that  A  *  V3*  WV  **  and  Qi  ■  V  ^  P^  With  this  notation,  for 
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APi  =  AV*5  =  V*5  WV"1*  Qt  =  WQi 
*  V*5  UjQi)  -  \±  V^  v~h  ?L  -  xA  Pi. 

Thus  is  an  eigenvector  of  A  with  eigenvalue  X^,  i=l,...,n.  On 

the  other  hand,  because  Q^Q-[  +  . . .  +  QnQ^  *  I  by  assumption,  we  have 

W~H  px)c V~H  px)'  +  ...  +  C v~h  Pn) (V'h  Pny  =  I. 


Hence 

V~H  P.  P’  v'h  +  ...  +  V~H  vn  p'  V~h  *  I, 

11  n  n 

which  holies  that  P^  +  ...  +  Pnp^=  V,  i  =  l,2,...,n  or 


V  -  tjCT^  P^CT^  PL)«  *  ...  *  Tn(Tn-'  Pn)CTn-^  Pn)'  , 


where  Ti  =  pi  pi  13  Q[  VQi  >  0,  i-l,...,n. 


(ii)  In  case  V  is  singular,  there  exists  an  orthogonal  matrix  R  such 
that  RVR'  =  diag  (o^,...,o^,  0,...,0),  where  ex?  >  0 ,  i=l . .  r  <  n.  Ob¬ 

serve  that  AV  is  symmetric  if  and  only  if  (RAR') (RVR')  is  symmetric.  In 
fact  [(RAR' )  (RVR')]’  -  (RAVR')'  *  R(AV)'R'  *  R  AV  R’  *  (RAR')  (RVR')  if 
and  only  if  (AV) '  =»  AV.  Thus  without  loss  of  generality  we  may  assume 
that 
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where  D  is  an  r  x  r  matrix,  1  <  r  <  n,  and  D  is  p.d.  Partitioning 
correspondingly  A  leads  to 


AV  = 


•'S.l  "12 


A1 

^1  ^22 


f 

1 

D 

0 

o 

0 

J 

J 

A21D 


0 

0 


Because  AV  is  symnetric  by  assumption,  therefore  A^D  must  be  the 
(n-r)xr  zero  matrix  and  A^D  must  be  a  symmetric  matrix.  Because  D 
is  p.d.,  we  conclude  that  A?1  =  0.  Moreover ,  because  A^D  is  symmetric, 
it  follows  from  part  (i)  that  there  exist  normalized  eigenvectors 
Sp...,Sr  of  A^  such  that  D  =  +  ...  +  TrSrSr  ,  >  0, 

where  A^S^  3  ,  i=l,...,r. 


Letting 


6  R11 


we  note  that 


^1 

1 

A12 

r  1 

si 

A11s1 

AP.  - 

s 

1 

1 

A21 

A22 

J 

i 

0 

j 

! 

,  * 

Because  A^S^  *  A.S^  and  because  A^  *  0,  it  follows  that 
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AP. 


Xi  Si 


"  XiPi- 


Thus  P^,...,Pr  are  real  eigenvectors  of  matrix  A.  Moreover, 


?  ’ 

S, 

* 

s„ 

Wi  +  •••  +  TrPrPr  "  T1 

1°. 

CS{  ,0)  +  ...  + 

r 

i0 

Cs;,o) 


=  T, 


SjSJ  0 


+  ...  +  T_ 


c  qt 

r  r 


TiS-S,*  +  ...  +  t  S  S' 
ill  r  r  r 


This  terminates  the  proof. 


Lenma  2.2. 

If  matrix 


vn 

V12 

Vi2 

V22 

is  n.n.d. ,  then  RCV^)  CK^V22^* 
Proof. 

This  is  a  known  result. 
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Lemma  2.3. 

Let  V^2  be  an  r  x  fn  -  rl  matrix  and  let  V22  be  an  fn  -  r)x 
fn  -  r)  n.n.d.  matrix,  where  1  <  r  <  n.  If  RfV^)  c  ^22^’  t*ien  t*iere 
exists  an  n.n.d.  matrix  V11  of  order  r  x  r  such  that 

v  .  [Vn  V12 

v*  V 

V12  V22 

w 

is  n.n.d. 

Proof. 

This  is  a  known  result. 

Lerrna  2.4. 

Let  V  and  $  be  symnetric.  If  L(V  +  $)  =  $>,  then  (LV) '  =  LV 
and  (L$) r  =  L*. 

Proof. 

Became  <5  *  L(V  +  and  because  $  is  symmetric, 

$  =  (V  +  $)L'. 

Hence 


L$  =  L(V  +  #)L', 
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which  is  a  symmetric  matrix.  Moreover, 


LV  =  $  -  L$. 


Hence 


(LV)'  =  $  -  (L$)'  «  *  -  L*  =  LV. 

Thus  LV  is  symmetric  as  asserted. 


Lemma  2.5. 

Let  V  and  $  be  n.n.d.  matrices.  If  L(V  +  $)  =  $  and  if 
V  +  $  is  p.d.,  then  the  eigenvalues  of  L  are  in  the  interval  [0,1], 
Further,  if  V  is  p.d.  the  eigenvalues  of  L  are  in  the  interval 
[0,1). 


Proof. 

This  is  a  known  result. 


Lemma  2.6. 

Let  X  and  V  be  n  x  n  matrices.  Let  a:  S  +R  be  defined 

*  n*n 

by  ip (X)  =  tr  XVX' .  Then  \p  is  convex  if  V  is  n.n.d.  and  strictly 
convex  if  V  is  p.d. 


Proof. 


Letting  X  =  (x^,...,xn),  where  x^  e  R,  we  find  that 
4; (X)  =  x^Vx^  +  ...  +  xnVxn-  Because  the  sum  of  convex  (strictly  convex) 
functions  is  a  convex  (strictly  convex) ,  the  assertion  follows . 

Lemma  2.1 . 

Let  R(A)  C  R(V),  where  V  is  a  n.n.d.  matrix.  If  tr  A'VA  ■  0 
then  A  =  0. 

Proof. 

As  in  the  proof  of  Lemma  2.6  we  write  tr  A’VA  *  a'Va..  +  ...  +  a'Va  , 
r  linn 

where  A  =  (a^,...,an).  Fran  the  assumptions  it  now  follows  that 
aiVai  =  0  ^at  ai  =  where  S  R,  for  i  =  l,...,n.  Combining 

these  two  formulas  leads  to  Vb^  =  0,  which  implies  that  a^  =  0  for 
i  =  l,...,n.  Hence  A  =  0. 

Lemma  2.8. 

Let  R  be  an  n  x  n  orthogonal  matrix.  If  LY  is  admissible 
within  model  p.s.  Rn  *  V,  then  MZ,  where  M  *  RLR',  is  admissible 
within  model  with  p.s.  Rn  *  (RVRf:  V  S  V}.  Here  Z  stands  for  an 
n-variate  random  vector  with  p.s.  Rn  *  (RVR' :  V€U). 

Proof. 

See  the  paper  of  A.  Cohen  [1]. 
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III.  LA  MOTTE’S  THEOREM  AND  ITS  EXTENSION 

In  1978,  R.  La  Motte  [2]  announced  a  theorem  that  establishes  a 
tractable  characterization  of  admissible  estimators.  In  our  considerations 
we  shall  need  only  the  part  of  La  Motte 's  theorem  which  states  that  if 
LY  is  admissible  within  model  with  p.s.  P  =  if1  x  V,  then  there  exists  a 
nonzero  pair  ($,V)  e  [T]  such  that  L(<b  +  V)  =  4>.  Note  that  this  condi¬ 
tion  determines  L  uniquely  when  <t>  +  V  is  p.d.  A  drawback  of  La  Motte 's 
theorem  is  that  L($  +  V]  =  4>  may  reduce  to  L$  =  4,  $  singular,  even 
when  all  nonzero  matrices  in  V  are  p.d.  If  this  is  the  case,  then  L  is 
not  uniquely  determined  by  L4  =  4.  To  overcome  this  drawback,  we  may  use 
Theorem  3.4  established  in  this  Section.  This  theorem  applies  only  to 
matrices  L  which  have  a  particular  structure. 

First  we  recall  a  result  from  La  Motte’s  paper  [2]  which  gives 
necessary  and  sufficient  conditions  for  estimator  LY  to  minimize 
R(*|4>,V).  These  conditions  may  be  already  found  in  a  paper  of  C.R.  Rao  [4] 
in  the  particular  case  where  V  is  p.d.  and  $  -  99 ' . 

Theorem  3.1. 

Let  (4,V)  e  [T].  Then 

(i)  there  exists  a  n  *  n  matrix  L  such  that  L(V  +  4)  ■  4; 

(ii)  L  minimizes  R( *  1 4> ,V^  if  an  only  if  L(V  +  4)  *  4; 

(iii)  there  exists  a  unique  matrix  minimizing  RC *  I  if  and  only 
if  4  +  V  is  p.d. 
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Proof. 

If  (*,V)  G  [T],  then  both  $  and  V  are  n.n.d.  In  such  a  case 
V  +  $  is  p.d.  and,  therefore 

R(4>)  C  R(V  +  *). 

Consequently,  there  exists  a  matrix  L  such  that  L(V  +  $)=$>. 

To  prove  assertion  (ii) ,  recall  that 

R(L|*,V)  =  tr  L'LV  +  tr  (I  -  L)  *  (I  -  L)*. 

Since  (V  +  <D)  (V  +  4>)+  is  a  projection  operator  on  R(V  +  $) ,  we  have 
(V  +  <t)(V  +  $)+  =  <t.  Hence 

R(L|<t,V)  =  tr  L'LV  +  tr  [♦  -  L*  -  L'*  +  L'L*] 

=  tr  L'L(V  +  $)  >  tr  [4>  -  L$  -  L'$] 

-  tr  L(V  +  *)(V  +  <f)  +  (Y  +  <f)L'  -  tr  [L(V  +  #)  (V  +  $)+* 

+  L'$(V  +  $)(V+$)  -$] 

=  tr  [L(V  +  ♦)  -  $](V  +  $)  +  [L(V  +  $)  -$]’«•  tr  [$  - 

4(V  + 


We  have  used  here  the  fact  that 

tr  Q(V  *  $)  [L(V  +  $)]'  *  tr  $(V  +  $)  (V  +  $>)L' 

■  tr  L'$(V  +  ♦) ^(V  +  <t) 

»  tr  L’CV  +  $)(V  +  $)  +  * 

■  tr  L'4>. 
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Hence 

R(L|$,V)  *  tr  [L(V  +.  *)  -  *](V  +  *)+[LCV  +  *)  -  *] ' 

+  tr  [<$  -  $(V  +  $)%]. 

Note  that  L  does  not  appear  in  the  second  term  on  the  right  hand 

side. 

Because  (V  +  $)  +  is  n.n.d.,  the  first  term  is  ncnnegative.  Hence 
L  minimizes  R( •  |$,V)  if  and  only  if  L(V  +  <&)  =  $>  by  Lenina  2.7. 

Assertion  (iii)  is  obvious.  In  fact,  if  V  +  $  is  p.d.,  then  L 
is  uniquely  determined  by  L  *  <t(V  + 

The  following  two  simple  corollaries  to  Theorem  3.1  are  very  useful 
in  further  considerations.. 

Corollary  3.1. 

Let  L  and  M  be  n  *  n  matrices.  If  LP  *  AP,  where  X  e  [0,1] 
and  if  R(M|e,V)  <  R(L|e,V)  for  V  =  (1  -  x)PP'  and  $  =  XPP',  then 
MP  =  XP. 


Proof. 

If  $  *  \PP'  and  if  V  *  (1  -  X)PP' ,  then  *  +  V  *  PP' .  Conse¬ 
quently,  L($+  V)  *  (LP)P*  =  (XP)P'  3  <t.  Thus  L  minimizes  R(*|$,V) 
at  C$»V)  -  CxPP',(l  -  X)PPf).  Because  R(M| * ,V)  <  R(L| * ,V)  we 
conclude  that  R(M|$,V)  ■  R(L|$,V]  and  therefore  M(*  ♦  V)  ■  Using 
$  ♦  V  ■  PP',  we  note  that  M(4>  ♦  V)  -  MPP'  ■  XPP*.  Thus  MP  -  Xp  as 
asserted. 


Corollary  3.2. 


If  MU  is  as  good  as  LY  and  if  LP  *  P,  then  MP  *  P. 

Proof. 

By  assumption  R(M|$,V)  <  R(Lj$,V)  for  V  ■  0  and  $  *  PP'. 
Now  LP  3  P  yields  LPP'  »  PP'.  Hence  MPP'  *  PP'  by  Theorem  3.1. 
Consequently,  MP  •  P. 


Theorem  (La  Motte)  3.2. 

If  LY  is  admissible  within  model  with  p.s.  P  »  P11  *  V,  then  there 
exists  a  nonzero  point  ($,V)  €  [T]  such  that  L  minimizes  R(*|<&,V). 


Proof . 

As  already  shown 

R(L|*,V)  *  tr  [L(*  +  V)  -♦](*  +  V)  +  [L(*  +  V)  -  «] 

+  tr  [$  -  *(*  +  V)$] . 


Let 

B  *  {(V,$):  V  and  *  are  n.n.d.,  tr  (W  ♦  $$)  =  1}. 


Let  W  be  the  convex  hull  of  [T]  n  E.  It  should  be  noted  that 

(0,0)  W.  Suppose  to  the  contrary  that  (0,0)  So/.  Then  there  would 

s 

exist  points  (*i»V1),...,(*s>Vg)  in  {T]  n  e  such  that  T  *  0 


L 
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s 

and  Z  t.V.  ■  0  where  the  t's  are  positive.  However,  since  the  V's 

i*l  1  1 

and  4 >'s  are  n.n.d. ,  therefore  -  ...  *  V§  *  0  and  4^  *  ...  *  4>s  *  0. 

This  contradicts  the  assumption  that  (4^,V^)  €  E  for  i  *  l,...,s. 

It  should  also  be  noted  that  for  each  ($,V)  €  [T]  there  exists  a 
point  (40,VQ)  €  w  such  that  (*»V)  -  T(<fg,V0),  where  t€R+, 

Now  define  a  function 

f-  W  -  S„Xn 

nxn 

by 

f(4,V)  -  L(*  ♦  V)  - 

This  is  a  linear  mapping  and  hence  preserves  compactness  and  convexity. 

Thus  the  set  W  ■  (f(4,V):  (4,V)  €  ft/}  is  conpact  and  convex  in  the 

product  space  _ .  We  have  to  show  that  if  LY  is  admissible,  then 

there  exists  a  nonzero  point  (4,V)  €  [T],  such  that  L  minimizes 

R(*|$*V).  To  prow  this,  it  is  sufficient  to  show  that  (0,0)  €W.  In 

fact,  if  (0,0)  £  w  then  there  exists  a  pair  (4,V)  €  ft/  such  that 

L(V  +  4)  -  4  *  0,  and,  therefore,  L  minimizes  R(*|$>V)  by  Theorem  3.1. 

Suppose  to  the  contrary  that  (0,0)  £  W.  Because  W  is  closed  and 

convex,  the  separating  hyperplane  theorem  assures  the  existence  of  a 

matrix  H  in  S _ _  such  that  for  all  X  €  w 

nxn 


(3.1) 


tr  XH'  <  0. 
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Now  for  Y  6  R  define  matrix  M  ■  L  +yH*  Note  that 
R(M|*,V)  *  tr  (L  +  yH) ' (L  ♦  yH)V  +  tr  [(I  -  L  -  YH) • (I  -  L  -  yH)4] 

-  tr  L'LV  +  Ytr  [L'HV  +  Ytr  H'LV  ♦  Y2tr  H'HV 

♦  tr  (I  -  L)'(I  -  L)*  -  ytr  (I  -  L) 'HO 
-  Ytr  H'(I  -  L)  +  Y2tr  H'H4 

*  tr  L'LV  ♦  tr  (I  -  L)'(I  -  L)*  +  2Ytr  [L'HV  -  (I  -  L) 'HO] 

♦  Y2tr  H*H’ . 

Hence 

R(M|4,V)  -  R(L|*,V)  -  Y2tr  H4H'  +  2Ytr  [L(4  ♦  V}  -  4]H\ 

Because 

tr  [L(V  +  4)  -  4]H'  <  0 

for  (4,V)  €  W,  we  conclude  that 
tr  H(V  +  4)H'  >  0 

for  all  (4,v)  In  fact,  because  V  +  $  is  n.n.d.,  tr  H(V  ♦  4)H'  * 

tr  H(V  +  4)^H(V  +  4)1*.  This  shows  that  tr  H(V  ♦  4)H'  >  0.  Now  suppose 
that  tr  H(V  +  4)H'  *  0.  Then  H(V  +  4)**  ■  0,  and,  consequently , 

(V  +  4)H'  ■  0.  On  the  other  hand,  for  all  (4,V)  €  W  we  have 
tr  [L (V  +  4)  -  4]H'  -  tr  [L(V  +  4)  -  (V  ♦  4)  +  (V  ♦  4)H'  - 
tr  [L  -  4(V  +  4)+](V  +  4)H'  *  0  which  contradicts  (3.1). 
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Thus,  letting  7f(4>,V,Y)  a  RCMjG.V)  -  RCLl'f.V), 

tt(4>,V,y)  -  ay2  ♦  by. 


where 


a  *  a($,V)  -  tr  H(V  +  <t)H'  >  0, 


while 


b  =  b($,V)  »  tr  [LO  +  V)  -  *]H'  <  0 

for  all  (4>,V)  €  W. 

Then  for  arbitrary,  but  fixed  (<t>,V)  €  W,  the  quadratic  polynomial 

2 

in  y  achieves  its  minimun  value  of  -b  /a  when  y  *  S  *  'b 
Since  g,  considered  as  a  mapping  from  W  to  R  is  continuous  and 
strictly  positive  on  the  compact  set  W,  there  exists  e  >  0  such  that 
g(*,V)  >  £  for  all  ($,V)  6  W.  We  see  that 

e  *ir($,e)  <  g($.V)  *7r(*,V,g(<f,V))  <  0 

for  all  ($,V)  €  W.  Hence 

R(L  ♦  e H|$,V)  <  R(LJ$,V) 

for  all  ($,V)  €  [T]  and  strict  inequality  if  ^ri2,V22’*22^  *s  *n  ^ 
This  contradicts  the  assumption  that  LY  is  admissible  and  shows  that 
(0,0)  €  W. 


/a. 
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Now  we  proceed  to  establish  the  above  mentioned  extension  of 
La  Motte's  theorem.  This  extension  refers  only  to  the  subset  L  of  all 
n  x  n  matrices  of  the  form 

L11  L12  ] 


where  is  an  arbitrary,  fixed  r  x  r  matrix,  while  1  <  r  <  n. 

First  we  show  some  preliminary  results. 

Ijtifttfici  3.1. 

Let 


L11  L12 


V  V 

V11  *12 

V I  V 

v12  v22 


>  0  and  $ 


*11  *12 
*12  *22 


>  0, 


where  4l»  V11  and  are  r  *  r  matrices.  Then 


V 

•  > 

I 

R(L|*,V)  -  R(L22|$22,V22)  +  tr  [(I,L12)A 

*  (I,-L12)B 

*42 

where 


4lVll4  L11V12 


V'  L' 
V12L11 


while 
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B  = 


CI  ’  Lll)*ll(I  ’  ^  '  Cl  -  Ln)$ 


12 


$12(-1  ‘  Lll^ 


22 


Proof. 


First  note  that 


i  *  Ci,l12)a 


L12 


CI,l12) 


lii  0 


V 


Hi 


(L11,L12)V 


Lill 

Hz 


so  that 


tr  a,  *  tr 


41 

42 


(lu,l12)v. 


Similarly 


a2  =  (I»”L^2)B 


•42 


(I  _  ^n»"^i2^ 


:'4i 


-I  f 


J12 


and 


tr  a,  *  tr 


x’Lii 

L12 


(I  -  L11»‘Ll2)<f. 


Next  observe  that 


R(L|$,V) 


tr 


4i 


I  '  T  » 

LU  L22 


L11  L12 


'22 


+  tr 


1  -  4i  0 


12 


I  -  L 


22 


I  -  L. 


11 


-L, 


12 
I  *  L, 


22 


=  tr 


L  *  T  I  •  T 

11L11  4lL12 


I  *  T  +  I  '  T 
L12  i2  l22L22 


4241 

a  -  L’pa-  lu) 


+  tr 


•a  *  L'  )L. 


11'  12 


'L12(-1  *  Lll^  L12L12+  ^  '  l22^1  '  L22^ 


tr  Aj  +  tr 


0  L  *  L„„ 
22  22 


V  +  tr  A- 


+  tr 


a  -  42)a-  l22) 


as  asserted. 
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Theorem  3.3. 


L  * 


Let 

hi 

L11 

hz 

0 

hz 

> 

€  L  minimizes  RM$.V)  among  L  if  and  only 


(3.2) 


L12^22  +  $22')  "  'L11V12  +  ^  "  L11^12 
L22^V22  +  $22-*  =  $22* 


Proof • 


Let  A  and  B  be  defined  as  in  Lemma  3.1.  Put 


*11 

*12' 

fBll 

B12 

A  * 

and 

B  = 

*12 

A22 

! 

B12 

B22 

where  and  are  r  x  r  matrices.  Because  A  and  B 

therefore 


R  (A^2^  R(A22  +  ®22^ 

and 

RCBy  C  RtAj2  *  B22). 

Hence  there  exists  a  matrix  H  such  that 

A12  '  B12  "  <*22  *  B22)H- 


Matrix 

if 


are  n.n.d 
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For  convenience  let  X  =  L^-  Note  that  by  Lemma  3.1 

>  f  > 

I  I 

R(L|$,V)  =  R(L22|$22,V22)  +  tr  [ (I ,X)A  +  (I,-X)B  ] 

X'  xf 

. 

Also  note  that 


I  I 

(I,X)A  +  (I,-X)B 

X’  X’ 


J'n*XWi2-  BiP  *«i2  -  bi2>X' 

*  X(Aj2  .  b22)X' 


and  that 


Hence 


fX(A22  +  B22)  +  A12  -  B12J(A 22  +  B22)  +  [XCA22  +  B22)  -  A^  -  B 12]  ’ 

"  X(Aiz  -  ^  +  ^2  -  Bl^x’  +  X^A22  +  B22)X' 

+  fA12  ’  B12^  fA22  *  B22)  +  fA12  '  B12)  '  • 


R(L|$,V)  =  RCL22|4>22,V22^  +  fX(^A22+B22^+  ^2  '  B12^A22  +  B22') 
+  [XfA^  + B22)  + Aj2  -  B12] 

+  Ajj  -  (A12  -  B12)  (A^  +  B22)  (Al2  -  B12)  ’ . 


Because  (^22  +  B22^  is  n.n.d.  and  because 


I 


£((^2  +  B22-*X  +  ^2  '  B12^  C  R^A22  +  B22^ 


it  follows  from  Lemma  2.7  and  Theorem  3.1  that  L  minimizes  R(*|$,V) 
among  L  if  and  only  if  conditions  (3.2)  are  satisfied. 

Let  us  now  introduce  the  following  notation.  As  above,  let 
P  =  R11  x  1/  be  the  considered  parameter  space.  Let  1  <  r  <n  and  let 
1/  and  E  be  subsets  of  Srx(n.r)  *  S(n_r)x(n-r)  defined  by 
V  -  {(V^ 2’^22’$22^ :  t*iere  exist  matrices  V^,  such  that 


vn 

V  ^ 
V12 

hi 

hi 

V* 

l  12 

V22 

f 

hi 

\ 

*22 

e  [T]> 


and  by 


E  "  t(Vi2>V22,$22^ :  tr  V12V12  +  tr  V22V22  +  tr  $22$22  ~  1^’ 


respectively.  Let  W  be  the  convex  hull  of  1/  n  E.  Note  that 
^■°rx(n-r)  ,0(n-r)x(n-r)  ,0(n-r)x(n-r)^  ^ 


Theorem  3.4. 

Let  W  be  contact. 

then  there  exists  a  point 


If 


0 


C*,V)  e  [T] 


with 


and  if  LY  is  admissible, 
(Vl2»v 

22^22?  *n  W  suc^ 


3.14 


that  L  minimizes  R(*|<&,V)  among  the  class  L.  Moreover,  ($>,V)  may 
be  selected  in  such  a  way  that  and  ^2  raeet:  conditions  (3.2),  i.e.. 


^12^22  +  ^22^  =  +  (I  • 


11*12 


11^12 


L22^22  +  ^22^  =  $22‘ 


Proof  m 


Theorem  3.4  is  proved  essentially  in  the  same  way  as  Theorem  3.2, 
although  the  details  are  more  complex.  Let  5  =  ^  x  5(n-r)x (n-r) 


Define  a  function 


f:  W  S 


by 


^12^22^22)  ~  ^12*^22  +  $22^  +  L12V12  '  "  L11')$12,L22 ^22  +  $22^  '  $22* 

Let 

W  =  {£(Vl2.V22^22^:  ^12’V22,$22-*  G  * 

Note  that  f  is  a  linear  mapping.  Therefore  W  is  compact  and  convex, 
because  W  is  compact  and  convex  by  assumption.  To  prove  the  theorem,  it 
is  sufficient  to  show  that  (0^  (n.r)  ,0(n-r)x(n-r)^  e  W"  SuPPose  that 
(0,0)  f.  W.  Then  the  separating  hyperplane  theorem  assures  the  existence  of 


3. IS 


tr  X-jHJ  +  tr  X2H'2  <  0. 


a  pair  of  matrices  (H 12»H22)  111  T  such  that  for  all  (X1>X2)  €  W 

C3.3) 

Now  for  y  €  R  define  matrix 

M  -  L  + 

Clearly,  M  EL. 

Let  A  and  B  be  defined  as  in  Lenina  3.1.  Then 


f 

* 

* 

1 

0 

«12 

4i 

42  *  •'H12 

0 

H22 

4 

0 

L22  *  yH22 

R(L|*,V)  =  R(L22r$22,V22)  +  tr  [CI,L12)A 


and 


I 


Lh 


+  CI,-L12)B 


f  \ 

I 

-L12 


R(M|$,V)  -  R(L22  +  yH22|$22,V22)  +  tr  [(I,Lj2  +  yH^A 


42+^2 


+  »"^12  ~  xHi2)B 


-42  -  ^2 


]. 


We  need  to  find 

irC*,V,y)  -  R(M|<f ,V)  -  R(L|*,V). 

First  we  find 

R(-L22  +  yH22 I<I>22,V22^  '  R^L22 1 *22 *V22-^  "  ^  tT  ^22^22  +  $22^  H 22 

+  2y  tr  [L22CV22  +  *22)  -  *22^22* 


The  remaining  term  becomes 


Y  tr  H12(A22  +  ^22^2  +  2Y  tr  ^^12  "  B12  +  L12(-A22  +  B22^H12‘ 

Thus 

Tr($fV,y)  Y  tr  [H22(V22  +  $22^22  +  H12^22  +  $22^H12^ 

+  2y  tr  {  [L22($22  +  V22)  '$22^22 

+  ^12^22  +  *22^  +  L11V12  "  ^  ‘  L11^12^H12} 

2 

~  ay  +  2b  y. 

Now  observe  that  a  >  0  and  b  <  0  for  all  ^\2^22^ 22)  e  W"  ^Quality 
a  <0  leads  to  a  contradiction  with  (3.3).  We  may  now  proceed  along  the  same 
lines  as  in  the  proof  of  Theorem  3.2,  and  conclude  that  MY  is  better  than 
L°Y.  This  contradicts  the  assumption  that  LY  is  admissible.  Hence 
(0,0)  e  W,  which  yields  the  desired  result  by  a  similar  argument  as  in  the 
proof  of  Theorem  3.2. 

In  case  5  I  we  have  the  following  two  corollaries. 

Corollary  3.3. 

I  L,  2 

Suppose  that  L  *  ,  where  I  is  r  x  r,  and  that  the  cor- 

0  l22 

responding  set  W  is  compact.  If  LY  is  admissible  then  there  exists  a 
nonzero  point  (4>,V)  e  [T]  with  ^12*^22*^22}  e  W  such  ^at  ^  minimizes 


R(* ! 4 , V)  among  the  class  of  matrices  of  the  form 


I  L, 


0  L- 


Moreover, 


(<t,V)  may  be  selected  in  such  a  way  that  L 12  and  L22  meet  the  following 


two  conditions: 


(3.4) 


L12^22  +  $22')  =  "V12 
L22(-V22  +  $22‘)  =  *22* 


Corollary  3.4. 

1  L12 

Suppose  that  L  *  ,  where  I  is'  r  *  r,  has  an  r-fold 

o  l22 

degeneracy  for  the  eigenvalue  A  =  1,  i.e.,  that  L12Q  ?  0  for  all 
Q  €  Rn  r  such  that  L22Q  =  Q.  If  L  meets  conditions  (3.4)  at  a 
nonzero  point  ’  t^ien  ,V22  can  not  t^e  zero  matrix • 


Proof. 


Suppose  on  the  contrary  that  V22  =  0.  Because  V22  *  0  implies 


that  V^2  *  0,  conditions  (3.4)  reduce  to 


L12*22  "  0 


L22*22  =  *22* 

This  shows  that  there  exists  a  nonzero  vector  Q  €  gn’r  such  that 
l22Q  *  Q>  Li2Q  *  °»  because  *22  ^  0  by  assumption.  This  contradicts 
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the  assumption  that  L  has  an  r-fold  degeneracy  for  eigenvalue  X  *  1. 
Thus  V22  f  0. 

A.  Cohen  has  shown  in  [1]  that  LY  is  admissible  within  model  p.s. 

Rn  x  [I]  if  and  only  if  L  is  synmetric  and  the  eigenvalues  of  L  are 
in  the  closed  interval  [0,1].  The  main  element  in  his  proof  was  the 

If 

observation  that  MY,  where  M  =  [I  -  (I  -  L) '  (I  -  L)  ] '  is  better  than  LY 
if  L  is  asymmetric.  Using  a  lenrna  due  to  N.  Shinozaki,  C.R.  Rao  [4] 
extended  this  result  to  models  with  p.s.  Rn  x  [V],  where  V  may  be  any 
p.d.  matrix.  Now  we  shall  show  that  Cohen's  theorem  and  its  extension 
follow  straightforward  from  Theorems  3.2  and  3.4.  In  the  last  section 
we  shall  prove  a  theorem  (see  Theorem  5.2)  which  includes  these  results 
as  a  particular  case. 

Theorem  3.S. 

Consider  a  model  with  p.s.  F  =  Rn  x  [V] ,  where  V  is  a  p.d.  matrix. 
In  order  that  LY  is  admissible  within  model  with  p.s.  P  it  is 
necessary  and  sufficient  that  LV  is  symmetric  and  the  eigenvalues  of 
L  are  in  the  closed  interval  [0,1]. 

Proof. 

(i)  To  show  that  the  conditions  of  Theorem  3.5  are  sufficient,  let 
us  first  assune  that  the  eigenvalues  of  L  are  in  [0,1).  Because  matrix 
is  symmetric,  it  can  be  presented  in  the  form 

vV  -  Z  X.P.P!, 
i«l  111 
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where  P^, . . . ,Pn  are  linearly  independent  orthogonal  eigenvalues  of  L 
corresponding  to  eigenvalues  respectively. 

Hence 


L  = 


Because  by  assumption  0  <  X^  <  1,  it  follows  that  0  <  1  -  X^  <  1. 
Consequently, 

(I  -  V’V5)'1  -  ?  r^-5— P.P!, 

i*l  1  -  i  11 


so  that 


Cl  -  L)"1 


Hence 


(I  -  L)"iL  . 


n 

l 

i=l 


1  *  A, 


V^PiPiV* 


and,  finally, 


Cl  -  L)_1LV 


n 

Z 

i=l 


-  X. 

l 


vVpjV**. 


1  1 


We  have  shown  that  if  LV  is  synmetric  and  if  the  eigenvectors  of  L  are 
in  [0,1),  then  4>  *  (I  -  L)  *LV  is  n.n.d.  Now  rewrite  *  *  fl  *  L)  *LV  in 
the  fonn  of  L(V  +  $)  ■  $.  Theorem  3.1  implies  that  L  minimizes  RC*I$»V)» 
and  since  V +  ♦  is  p.d.,  we  conclude  that  LY  is  admissible. 


(ii)  If  X  *  1  is  an  eigenvalue  of  L,  then  L  may  be  represented 


in  the  form 


L  = 


12 


12 


,  I  is  r  x  r. 


where  r  is  the  maximal  number  of  linearly  independent  eigenvectors  of 
L  corresponding  to  x  *  1.  Because  L  is  semisimple,  all  the  eigen¬ 
values  of  1^2  are  in  the  interval  [0,1)..  Now  observe  that 


LV 


12 


J22 


'll 


viz 


12 


22 


Vll*I12Vi2 

L22Vi2 


Since  LV  is  symmetric,  we  obtain  that 


(a)  ^22^22  symmetric 


V  + 1  V 
12  L12v22 

L22V22 


(b)  v12  +  l12v22 


(L22vi2)'  -  Vi2L22 


(y)  L12V12  *s  *5™***:. 


-1, 


As  shown  in  part  (i) ,  it  follows  from  (a)  that  (I  -  L22)  ^22^22  is  a 
n.n.d.  matrix.  Put  $22  ■  (I  -  L??)  From  (g)  it  follows  that 


22'  22  22 ” 


12 

-1, 


V12tl22  '  «V22' 


Using  $22  *  (I  -  L22)  ^22V22  we  note  ^at 


i 


3.21 


*12  ^22  **22^  *  V12^22  ”  ^V22^22 +V22L22^  '  L22^  ^ 

■  V12<l22-I’fI*L22CI-L22)'1 

■  V12(LJ2  -  I)  t(I  -  42)  +  LfcHI  -  4j)  _1 

’  V12(42'I)(I't22>"1 


Consequently, 


meets  conditions  (3.2)  appearing  in  Theorem  3.3,  i.e., 


Hence  the  matrix  L 


^.2^22  +  *22^  "  "V12 
L22^22  +  *22^  "  *22  ‘ 


I 


minimizes  R(*|$,V) 


L^2  and  at  all  points  ($,V),  where 

while  are  selected  so  that  $  is 


$ 


11 


♦ 


12 


n.n.d. 


with  respect  to 


Cl  -  L22) 


•1 


L22V22 
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Because  V22  +  $22  P-c*’»  estimator  LY  is  uniquely  determined,  and 

therefore,  LY  is  admissible. 

This  terminates  the  proof  of  sufficiency. 

(ii)  Now  suppose  LY  is  admissible.  By  Theorem  3.2,  there  exists  a 
nonzero  pair  (4,V)  £  [T]  such  that  L(4>  +  V)  ■  4.  If  V  +  0,  the 
assertion  follows  from  Laimas  2.4  and  2.5.  If  V  =  0,  then  L(4  ♦  V)  *  4 
reduces  to  L4  =  4,  where  4  f  0.  In  this  case  X  *  1  is  an  eigenvalue 

f1  l12 

of  L.  Without  loss  of  generality  we  may  assume  that  L  *  , 

[°  L22^ 

where  I  is  r  *  r,  and  L12Q  i  Q  for  all  Q  e  i^'x  such  that 
L22Q  3  Q-  By  Corollary  3.3  there  exists  a  point  ^\2^22^22)  e  W 

such  that  L22CV22  +  $22^  “  <t22’  L12^V2'>  *  *  ‘V12’  86031:156  v->2  *  0 

by  Corollary  3.4,  it  follows  that  V22  +  4,2  is  p.d.  Hence  by  Lemma  2.5, 
all  eigenvalues  of  L22  are  real  and  are  in  [0,1],  Moreover,  LV  is 
symmetric.  (This  is  shown  after  Theorem  4.1.) 

In  the  next  two  sections  we  shall  show  that  by  using  the  characteri¬ 
zation  of  admissible  estimators  established  in  Theorems  3.2  and  3.4,  various 
extensions  of  Cohen’s  result  to  models  more  general  than  the  ones  considered 
by  Cohen  himself  and  by  C.R.  Rao  are  possible. 


4.1 


IV.  FIRST  TWO  BASIC  THEOREMS 


In  this  section  we  shall  prove  two  basic  theorems  --  Theorems  4.1 
and  4.2.  The  first  one  establishes  necessary  condition  for  admissibility 
of  a  linear  estimator  within  model  with  p.s.  P  =  Rn  x  1/  without 
additional  assumptions  placed  on  1/ . 

The  second  theorem  may  be  considered  as  a  generalization  of  Cohen's 
theorem  to  n.n.d.  matrices. 

First  we  shall  establish  two  lemmas  that  are  needed  to  prove  the 
results  of  this  section.  As  above  let  Y  be  an  n-variate  random  vector 
with  parameter  space  P  =  Rn  x  l > .  Consider  in  addition  an  (n-r) -variate 
random  vector  Z  with  parameter  space  P  =  Rn  T  x  1/ ,  where  (/  is  a  sub¬ 
set  of  S  (n-r)x  (n-r)  defined  by  ^  =  ^V22:  t*iere  ex*st  311  r  *  r  matrix 


and  an  r  x  (n-r)  matrix  V12 


such  that 


11 

V12 

’» 

12 

G  V} . 


Lerma  4.1. 


If  LY  is  admissible  within  model  with  p.s.  P  *  R n  <  1/  and  if 

,  where  is  (n-r)  *  (n-r) ,  then  L77Z  is  admissible 


hi  L12 

0  L 


22 


within  model  with  p.s.  P  *  Rn  r  *  1/ 


J 


4.2 


Partition  9  into 

and  V  into 

vn 

V12 

92 

V12 

V«. 

where  9^ 


is  r  x  1  and  Vj.  is  r  x  r.  By  virtue  of  Lenma  3.1  we  have 

R(L|0,v)  -  Ra22|022,v22)  RgCLipL^.e^V), 

where  the  last  term  is  nonnegative  for  all  (B,V)  G  P,  G  and 

L^2  £  ..  This  implies  that  L22Z  is  admissible  within  model  p.s. 

P.  In  fact,  otherwise  LY  would  be  inadmissible  within  model  with  p.s. 
P. 


Theorem  4.1. 

If  LY  is  admissible  within  model  with  p.s.  Pn  *  v  ,  then 

(i)  the  eigenvalues  of  L  are  real  and  in  the  closed  interval 

[0,1]; 

(ii)  there  exists  a  nonzero  matrix  V  e  v  such  that  LV  is 
synmetric. 


Proof. 

Because  LY  is  admissible,  there  exists  by  Theorem  3.2  a  nonzero 
pair  O.V)  €  [T]  such  that 


(4.1) 


L(*  ♦  V) 


•  4. 


4.3 


Thus  L($  ♦  V)  is  symmetric  and,  therefore,  by  Laima  2.1  matrix  L  has 
r  »  rank  ($  ♦  V)  independent  real  eigenvectors  such  that  4>  +  V  = 
r 

l  t.P.P!,  where  t,  ,...,r  are  some  positive  numbers.  Suppose  that 
i-1  1  1  1  1  r 

?!»••• *Pr  correspond  to  eigenvalues  x^,X?,...,Xr  of  L,  respectively. 
Then 

r  r 

(4.2)  *  -  L(V  +  *)  -  I  t.LP.P!  =  e  T-x.P.PJ, 

i-1  1  11  i-1  1  1  1 


and,  therefore, 


(4.3)  V  -  (*  +  V)  -  ♦  -  It(l-  X . )P. P! . 

i-1  1  111 


Because  <5  and  V  are  n.n.d.,  it  follows  from  (4.2)  that  X^  >  0  and 
from  (4 . 3)  that  1  -  \  ^  >  0 .  Thus  0  <  x  ^  <  1 ,  i  »  1 . r . 

To  show  that  the  remaining  eigenvalues  of  L  are  real  and  in  [0,1] 
when  r  <  n,  let  us  choose  an  orthogonal  matrix  R  such  that 

^1  NLL2 

M  -  RLR'  - 

0  M,2 

where  is  r  x  r  and  has  eigenvalues  X^,...,Xr.  Moreover,  let 

1/  =  (RVR':  V  €  1/} . 


Since  LY  is  admissible  within  model  with  p.s.  R°  x  V,  estimator  MZ 
is  admissible  within  model  with  p.s.  R31  x  V .  Clearly,  2  stands  here 


4.4 


for  an  n- variate  random  variable  with  p.s.  Rn  *  V.  Now  from  Lemma  4.1 
it  follows  that  M 22 X  is  admissible  within  model  with  p.s.  Rn  r  *  Uf 
where  U  is  defined  by  u  =  {V,2:  there  exist  an  r  *  r  matrix 


and  an  r  x  (n-r)  matrix  V12  such  that 


€  li}. 


t  J 

It  should  be  obvious  that  X  stands  here  for  an  (n-r) -variate 

n«r 

random  variable  with  p.s.  R  x  U.  In  view  of  the  above,  we  may 
conclude  that  M22  has  at  least  one  eigenvalue  in  [0,1],  which  is 
evidently  also  an  eigenvalue  of  L.  If  necessary,  we  may  repeat  the  rea¬ 
soning  a  number  of  times  more  to  conclude  finally  that  all  eigen¬ 
values  of  L  are  in  [0,1]. 

We  need  yet  to  show  that  there  exists  a  nonzero  matrix  V  such 
that  LV  is  symmetric.  Clearly,  this  assertion  follows  from  (4.1) 
by  Lemma  2.4  if  V  is  not  the  zero  matrix.  In  case  V  is  the  zero 
matrix,  (4.1)  reduces  to  L$  =  $.  Then  as  already  noted  above  x  =  1 
is  an  eigenvalue  of  L.  Suppose  that  L  has  an  r-fold  degeneracy  for 
X  =  1.  Without  loss  of  generality  we  may  then  assume  that  L  is  of 
the  form 


L 


I 

0 


I  is  r  x  r, 


where  L^Q  t  0 
Now  let  W 


if  L22Q  =  Q. 

be  defined  as  in  Theorem  3.4. 


If  W  is  compact,  then 


by  Corollary  3.3  there  exists  a  point 


4.5 


(y)  l^V 22  is  symmetric. 


4.6 


To  show  (a)  note  that 


\‘Fll  =  “L12^V22  +  $22^L12‘ 


To  show  (8)  note  that 


V12  +  L12V22  =  'L12$22 


=  -\2^22  +  *22)  $22 
=  V12CV22  +  $225  $22 


=  V12^22  +  ^22^  ^22  +  $22)L22 


"  V12L22' 

Finally,  (y)  follows  from  Leirana  2.4,  because  L22^V',2’+  ^22^  =  $22’ 

Now  we  shall  consider  the  case  when  W  is  not  compact .  Then  there 
exist  some  sequences  ($22^  an<^ 

v(a)  = 


» 

’ll 


vCn) 

12 


v,  (n)  v(n) 

v12  22 


such  that 


y  s  n/Cn)  yOO  s  lil 

Xn  lv12  ,V22  ’®22  J 


v  .  v  _  nrCO)  y(0)  a(0)-\  SC  ft/ 
Xn  l  "  ^12  ’"22  ’*22  }  *  * 


and 


4.7 


Now  let  1/  be  a  closed  convex  cone  of  n  x  n  n.n.d.  matrices  defined 
by 

W  0 

•  W  E  U}  > 

0  oj 

where  U  may  stand  for  an  arbitrary  closed  convex  cone  of  r  x  r  n.n.d. 
matrices,  where  1  ^  r  <  n.  As  above,  consider  an  n-variate  random  vector 
Y  with  p.s.  Un  x  1/  and  in  addition,  an  r-variate  random  vector  Z  with 
p.s.  Rr  x  U. 

We  shall  characterize  admissible  estimators  within  model  with  p.s. 

Rn  x  V,  where  !/  has  the  structure  described  above.  First  we  prove  the 


following  lemma. 


Let 


and  let 


f 


Cl  '  Ln)H 
I 


,  where  H  may  be 


an  arbitrary  rx  (n-r)  matrix,  such  that  Cl  *  L^)  =  (I  "  Ljj)  ’  Cl  ~  L^H. 

Such  a  matrix  H  always  exists,  because 


RCCI  -  Lu)’)  C  R((I  -  LjP’CI  -  Lu)). 


Lemma  4.2. 

Within  model  with  p.s.  Rn  x  1/  estimator  L^Y  is  as  good  as  LY  and 
better  than  LY  when  RfL^)  £  R(I  “  L^) . 


Proof. 

Note  that 


I_4l 

■42 


R(L|9,V)  *  trL^L^  +  e' 

and  that 

R(L0|9,V)  =  tr4i4iw  +  9’ 

Denote  by  (I  -  L^)"*"  a  matrix  such  that 

R(CI  -  Ln)-S  =  NCI  -  Lu) 


(I  -  Lii>'Li2^9 


1  -4i 

-H’CI-^)’ 


(I  -  1^,-CI  -  LU)H)9 


Then  there  exists  a  matrix  S  such  that 


Consequently, 


(4.4)  L'2L12  =  H'CI  -  Lyci  -  lu)h  *  s*fci  -  i^H'd  -  lu)1s. 

Because 

f  'i 

1  *  4l  (I  -  Ln) ’  (I  -  Lu)  'Cl  -  LXi)  'l12 

(i  *  Hi* 'H?3  * 

-H2  *H2ci  -  Hi3  H2H2 

1 

and  because 

i  - 1{±  -  Hi3  ’ (I  *  Hi3  * (I '  Hi3  ’ (I '  Hi3H 

(I  -l-j.-ci  -lu)h  * 

-H*  (I  *  Ln) 1  -H*  d  -  Ln)  ’  (I  -  Ln)  Ht  (I  -  Ln)  ’  (I  -  Ln)H 


we  note  that 

0  0 

R(L|a,V)  -  R(Lnle,V)  -  9’  9  . 

0  L’2L12  -H'(I-  Lu)  •  (I  -  LU)H 

Thus  Lu  Order  chat  LqY  be  as  good  as  LY  it  is  sufficient  that 


H2H2  >  H’CI  *  Hi),(I  '  Hi)H* 

However  this  follows  from  (4.4),  because 

[(I  -  L^SJ'CI  -  LU)1S  >  0. 


This  terminates  the  proof. 


4.10 


Now  we  are  able  to  prove  the  following  result. 

Theorem  4.2. 

Estimator  LY,  where 


L11  L12 
L21  L22 


>  Ln  is  r  *  r» 


is  admissible  within  model  p.s.  x  \J  if  and  only  if 
(i)  L2i  =  0.  L22  =  x»  RCL12)  C  R(I  -  Lu), 


and 


(ii)  is  admissible  within  model  with  p.s.  Rr  x  Li, 


First  suppose  that 

r  ' 

T  I 

“11  “12 

better  than 

L21  L22 

L2j  3  0  and 

L22  =  r"  * 

L11  L12 


1 


Y  is 


0  I 

Y  when  t  0  and/or  L77  f  I,  we  must  have 


J22 


Ll2  *  (I  -  L^H.  Otherwise 


L11  (I  '  L11)H 
0  I 

(I  -  L^)  * L^2  *  (I  •  '  (I  *  L^)H,  would  be  better  than 


Y,  where  H  is  such  that 


L- .  L, 

ll  i .4 


Y. 


Hence  k(L12)  c  Now  suppose  that  L^Z  is  not  admissible 

within  model  with  p.s.  Rr  x  U.  Let  M^Z  be  better.  Then  for  all 

we  u 

(4.5)  tr  ^  tr  L{1L11W 

and 

(4.6)  (I  -  MU)'(I  -  <  (I  -  Ln) '  (I  -  Lu) 

and 


(4.7)  r^i^.w)  <  R(Lnl  e1»w) 

for  all  (9,W)  €  Rr  x  U  and  strict  inequality  for  at  least  one  point  in 
Rn  x  U. 

Now  from  (4.6)  it  follows  that 


f  (I  -  M^'a  -  M11)  (I ,  -H)  <  (I  -  Ln)'(I  -  Ln)(I,-H) 

•H  -H ' 


Horw-o  fr\-r 


we  have 


(I-M^H 

I 


R(M|a,V)  <  R(L|9,V)  for  all  (9,V)  e  Rn  x  i/. 


4.12 


Because  LY  is  admissible,  it  follows  that 

R(M|9,V)  *  R(Ll9,V). 

This  implies  that  for  all  W  S  U 

tr  =»  tr  L^L^W 

and  that 

(I  -  Mu] '  (I  -  M1X)  =  (I  -  Lu)  *  (I  -  Lu) 

which  contradict  assumption  (4.7)  that  M^Z  is  better  than  L^Z.  Thus 
L^Z  is  admissible. 

Now  suppose  that  L  meets  conditions  (i)  and  (ii)  of  the  theorem. 

And  suppose  that  LY  is  not- admissible.  Let  MY,  where 

^1  a-  m11)s 

0  I 

be  better  than  LY. 

Now 

’  1  "Mil 

R(M|9,V)  •  tr  MJj.MjjW  *  9 ' 

-S  ’  (I  -  M^) ' 

If  R(M|9,V)  <R(L|0,V),  then 
tr  *  9£CI  *  Mn)'(I  -  M11)91  <  tr  L^L^  ♦  9;(i  -  L:.V(I  -  Lu)9 

Because  L^Z  is  admissible  by  assumption,  therefore  we  may  replace  <  by 


' 

(I  -  ^,(1  -  M11)S)9. 


4.13 


= .  But  in  this  case 


where 


0  <  R(M|  9  ,V)  -  R(L|e,V) 


(  'l 


’ll 

C12 

•1 

12 

C22 

=<  0 


C12  =  -Cl  -  NO  ’  ci  -  MU)S  +  (I  -  Lnr(I  '  Ln)H 


C'2  =  -SCI  -  M11) ?  (I  -  Mu)  +  H*  Cl  -  LU)*(I  -  Ln) 
and 

c22  =  S' Cl  -  M11),CI  -  M^S  -  H’(I  -  Ln)’CI  -  L^H 

so  that 


S' (I  -  MU)'(I  -  Mn)S  =  H'(I  -  LU)'CI  -  Ln)H 

by  using 

(I  -  ’  (I  -  J^)  -  (I  -  Ln) '  (I  -  Ln)  • 

Consequently,  RCMje,V)  *  R(L|9,V)  contrary  to  the  assumed.  This  contra¬ 
diction  proves  that  LY  is  admissible. 


W  0 

In  case  1/  =  [Vn],  where  Vn  3  ,  while  W  is  a  p.d.  matrix 

u  u  0  0 

of  order  r  *  r,  the  following  corollary  follows  immediately  from  Theorems 

(L  L 

L11  L12 

4.2  and  3.5.  Let  L  =  ,  where  L,,  is  r  *  r. 

T  I  ■u 

[L21  l22) 

Corollary  4.x. 

Estimator  LY  is  admissible  with  model  with  p.s.  Kn  x  1/  if  and 
only  if 

(i)  Ln  =  0,  L22  -  I,  R(L12)  C  R(I  -  Ln) 

and 

(ii)  L^jW  is  symnetric  and  the  eigenvalues  of  are  in  the 

closed  interval  [0,1]. 


5.1 


V.  THREE  MORE  THEOREMS  ON  ATMISSIBILITY 

In  this  section  we  show  first  that  all  linear  estimators  admissible 
within  model  Rn  x  l are  also  admissible  within  model  Rn  x  t/2  if 
l^l  c  1/ 2 -  ^ext  we  show  that  the  conditions  appearing  in  Theorem  4.1  are 
sufficient  for  LY  to  be  admissible  when  consists  of  p.d.  matrices 
only.  Finally,  we  establish  the  main  result  of  the  paper  that  if  1/  is 
the  set  of  all  n.n.d.  matrices,  then  LY  is  admissible  if  and  only  if 
all  the  eigenvalues  of  L  are  in  [0,1]. 

The  essential  tool  to  prove  the  above  theorems  is  the  following  easy- 
to-prove  result . 

Lemma  5.1. 

If  LY  is  admissible  within  model  with  p.s.  P  -  Rn  *  1/  and  if  MY 
is  another  estimator  with  the  same  risk  function,  i.e.,  R(Mle,V)  *  L(L|6,V} 
for  all  (9,V)  €  P,  then  M  »  L. 

Proof. 

By  Lemma  2.6  the  risk  function  R(L|6,V)  s  tr  L'LV  +  tr  (I  -  L) '  (I  -L)ee' 
is  a  convex  function  of  L  for  all  (9,V]  e  P  such  that  V  is  p.d. 

Sv^jpose  that  there  exists  a  p.d.  matrix,  say  VQ,  in  V.  If  T  =  *s(L  +  M), 
then  in  view  of  the  above  R(T|9,V)  <  R(L|8,V)  for  all  (9,V)  €  P  with 
a  strict  inequality  for  V  *  Yg  unless  L  ■  M,  and  this  contradicts  the 
admissibility  of  L.  In  case  all  matrices  in  ^  are  singular  we  may  assume 


5.2 


without  loss  of  generality  that  U 


W  0 
0  0 


:  W  e  u  },  where  not  all 


v  * 

matrices  in  U  are  singular.  By  Theorem  4.2,  matrices  L  and  M  must 


then  be  necessarily  of  the  following  form:  L 


r 


Ln  h2 

0  I 


M 


*11 

0 


M 


12 


and 


,  where  R(L12)  C  R(I  -  L^)  and  c  Rfl  -  M^) 


Moreover,  by  Theorem  4.2,  both  L^Z  and  are  admissible  within 

model  with  p.s.  Rr  x  U,  where  1  <  r  <  n.  Hence  =  L^,  since 

Lj^Z  and  M^Z  have  the  same  risk  function.  Fran  this  and  the  assumption 

that  LY  and  MY  have  the  same  risk  function,  we  obtain  that 

(I  -  Ln)  *  (Ml2  -  L12)  *  0  which  iiqplies  that  Mp  =  L^.  Thus  L  =  M  and 


the  proof  is  terminated. 

A  typical  situation  where  Lenina  5.1  may  be  used  is  the  following  one. 
Consider  two  models  with  p.s.  «  Rn  x  1/^  and  P?  *  Pn  x  l/,,  say. 
Assure  that  c  i/2  and  that  LY^  is  admissible  with  model  with  p.s. 

P^  The  question  is  whether  LY,  is  admissible  within  model  with  p.s.  ?,. 
To  answer  this  question  suppose  that  MY2  is  as  good  as  LY2  within  model 
and,  consequently,  also  within  model  P^.  Hence  R(M|9,V)  -  R(L|0,V) 
for  all  (9,V)  e  P^  because  LY^  is  admissible  within  P^.  Now  M  *  L 
follows  from  Lemma  5.1  so  that  the  following  result  holds. 


Theorem  5.1. 

Each  admissible  linear  estimator  within  model  with  p.s.  Rn  *  is 
also  admissible  within  model  with  p.s.  Rn  *  ^  if  t/j  C  l^2 . 


5.3 


Using  Lemma  5.1  and  Theorem  3.5  we  also  arrive  straightforward  at 
Theorem  5.2  belor  which  asserts  that  the  conditions  in  Theorem  4.1  are 
sufficient  in  case  1/  consists  of  p.d.  matrices  only. 

Theorem  5.2. 

Let  V  be  a  closed  convex  cone  of  p.d.  matrices.  Then  LY  is 
admissible  within  model  with  parameter  space  Rn  x  1/  if  and  only  if 
the  eigenvalues  of  L  are  in  [0,1]  and  there  exists  a  nonzero  matrix 
V  such  that  LV  is  synmetric. 

Proof. 

We  need  only  show  that  if  the  eigenvalues  of  L  are  in  [0,1]  and 
if  LVq,  where  VQ  G  I/,  VQ  f  0,  is  symmetric,  then  LY  is  admissible 
within  model  with  p.s.  Kn  x  l/. 

Suppose  that  LY  is  not  admissible  within  the  model  considered.  Then 
there  exists  a  better  estimator  than  LY.  Suppose  that  MY  better  than 
LY.  Then 

R(M|e,V)  <  R(L|e,V]  for  all  (e  ,V)  €  Rn  x  \j . 

In  particular, 

R(M|e,V0)  <  R(L|9,V0)  for  all  9  e  Rn. 

Since  LVn  is  syntnetric  and  since  the  eigenvalues  of  L  are  in  [0,1],  it 


5.4 


follows  from  Theorem  3.5,  that  LY  is  admissible  with  model  with  p.s. 

Rn  x  [Vq]  .  Thus  for  all  6  e  R11  holds 

R(Mj9  ,VQ)  =  RCLje,V0) . 

Now  we  may  apply  Lemma  5.1  and  conclude  that  M  =  L.  This  terminates  the 
proof. 

The  following  interesting  corollary  follows  straightforwardly  from 
Theorem  5.2  and  Theorem  3.5.  Let  [V]  denote  the  closed  convex  cone 
generated  by  n.n.d.  matrix  V. 

Corollary  5.1. 

Under  the  assumptions  of  Theorem  5.2  estimator  LY  is  admissible 
if  and  only  if  there  exists  a  nonzero  matrix  V€l /  such  that  LY  is 
admissible  within  model  with  p.s.  Rn  *  [I/]. 

The  following  example  illustrates  that  the  assertion  of  Corollary  5.1 
is  false  when  1/  contains  a  singular  matrix. 

Example  5.1. 

1  0 

Let  V  be  the  closed  convex  cone  generated  by  matrices  V_  = 

u  0  0 

'  >  [  \ 

10  10 

and  l \  s  .  Then  V={r  :  a  E  [0,1],  t>0}. 

A  0  1  0  a 


5.S 


First  we  show  that  LY,  where  L  =  ,  ,  is  admissible  within  model 

0  4 


with  p.s.  *  x  . 


i  o) 


Observe  that  L  meets  conditions  (3.2)  when  V  =  and 

0  1 

16  4 

4  =  .On  the  other  hand,  if  MY  is  as  good  as  LY,  then  M 

l4  fi  „  1 

I  "h. 2 

must  be  of  the  form  M  =  by  Corollary  3.1.  Moreover,  by 


0  m0 


1  0 


Theorem  3.3,  matrix  M  meets  conditions  (3.2)  for  V  =  and 

^  0  1 
16  4  l  J 

4  =  too,  i.e.,. 

4  1 


m17(l  +  1)  -  2 


m22^  +  =  !• 


Hence  m-^2  =  1  and  =  1,  and  consequently,  M  =  L.  This  shows  that 

LY  is  admissible  within  the  specified  model. 

Now  suppose  that  there  exists  a  matrix  V  e  v  such  that  LY  is 

2 

admissible  within  model  with  p.s.  R  x  V.  Then,  by  Theorem  4.1,  matrix 
LV  must  be  syiranetric.  Now  LV  is  symmetric  if  and  only  if 


1  0 

V  *  ,  because  LV  = 

0  0 


11  0 


0  a 


1 

7  a 


Now  observe  that  LY,  where  L  = 


,  is  not  admissible  within  model 


5.6 


r  \ 


with  p.s. 


R2  x 


As  already  established  LY,  where 


hz 

V  J 

2 

1 

0 

L  = 

12! 

1 

122j 

,  is  admissible  within  model  with  p.s.  R  x  [ 

0 

0 

> 

] 


if  and  only  if  l2l  =  0,  122  =  1  and  1^2  =  (1  -  ^h,  h  €  R,  by 

Corollary  4.1. 

Matrix  L  does  not  meet  these  conditions. 


Theorem  5.3. 

Let  1/  be  the  set  of  all  n.n.d.  matrices  of  order  n  *  n.  Then 
LY  is  admissible  within  model  with  p.s.  Rn  x  if  and  only  if  all 
eigenvalues  of  L  are  real  and  are  in  [0,1]. 

To  prove  this  theorem  we  need  the  following  result. 


Lemma  5.2. 

Let  L  be  of  the  form 

admissible  within  model  with 
admissible  within  model  with 


L  = 

p.s. 

p.s. 


X 

0 


,  where 


X  G  R . 


Then 


Rn  x  V  if  and  only  if  L-,-,2 
Rn-1  x  v  and  X  G  [0,1]. 


LY 

is 


is 


Here  Z 


rH"1 


X  V 


n-1* 


stands  for  an  (n-1) -variate  random  variable  with  p.s. 


5.7 


Fvoof. 

If  LY  is  admissible  within  model  with  p.s.  Rn  *  1/  ,  then  X  E  [0,1] 

by  Theorem  4.1.  Moreover,  L ^ -£•  is  admissible  within  model  with  p.s. 

Rn  *  x  1/  .  by  Lemma  4.1. 

n-1 

To  show  the  converse,  suppose  that  the  assertion  is  false.  In  other 
words,  assume  that  there  exists  an  estimator  MY  such  that 


R(M|  0,V)  <  R(L|0,V) 


for  all  (9,V)  E  Rn  x  V  and  strict  inequality  for  at  least  one  point  in 

Rn  x  V  .  Because  LP  =  *P  for  P  =  (1.0 . 0) '  we  note  that  MP  =  ,\P 

by  Corollary  3.1.  Hence 


M 


X  My 

0  M22 

.  y 


Because 


R(L|0  ,V) 


X 


0 


If* 


42 

VH  V12 

L22 

4  2  V22 

+  (0{  9^ 


fl-X 


*42 


1  "  L22 


fl-X 

0 


I  -  L 


22 


=  *2y11  +  2*L!2Vi2  +  tr  ^L12L12  +  L22L22^V22 


*  («J  8J) 

(1  -  X)2 

-d  -  X)L12  ! 

! 

r  8 

91 

-a  -*)l{2 

4242+CI*42)(I"L22)j 

i 

,e2. 

5.8 


we  have  for  all  (8 ,V)  e  Rn  x  Vn 

(5.1)  R(Lj0,V)  -  R(M|9,V)  =  R(L22|  02,V22)  ^  R(M22|  02>V22) 

+  ^12-^2^22 + 

+  2XCLl2-M12)Vi2-2(l-X)(Ll2-M12)0291 


>  0. 


Note  that  0^  appears  in  the  last  term  only. 

Since  ©2  and  0 ^  may  be  arbitrary,  inequality  (5.1)  implies  that 
Ll2  =  M12  in  case  X  f  1.  On  the  other  hand,  if  X  *  l,  then  (5.1) 
reduces  to 

(5.2)  R(L22|02,V22)  -  R(M22je2,V22)  =  tT  ^LizL12  ”Mi2Ml2-^  ^22  +029P 

+  2(L12 -ML2)V|2 


0. 


Since  does  not  appear  in  (5.2)  and  since  may  be  arbitrary, 

provided  R(V22)  c  we  conc^u<^e  ^rom  C5.2)  that  must  be 


equal  to  L17,  when  (5.1)  holds  for  all  (0,V)e  Rn  x  V  .  Therefore, 


12 


n 


in  either  event  (5.1)  reduces  to  R(M22|V22,82)  <  R(L22 1 V22 ,e2)  ^rom 
which  we  conclude  that  M22  *  L22  by  Lemma  5.1.  Thus,  indeed  M  *  L, 
and  this  contradicts  the  assumption  that  MY  is  better  than  LY.  Now 
we  are  in  a  position  to  establish  Theorem  5.3. 


Proof  of  Theorem  5.3. 


We  need  only  show  that  if  the  n  eigenvalues  X1,...,Xn  of  L  ire 
in  [0,1],  then  LY  is  admissible  within  the  specified  model.  The  converse 
is  guaranteed  by  Theorem  4.1. 

Let  be  an  eigenvector  of  L  with  eigenvalue  X^.  Assuming 

that  -  (1,0, . . . ,0) ’ ,  matrix  L  must  then  be  of  the  following  form 

» 

X1  L12 

L  =* 

0  L22 

To  prove  that  LY  is  admissible  within  model  with  p.s.  Rn  *  1/  ,  it 
suffices  to  show  by  Lemma  S.2  that  L22Z  is  admissible  within  model 
with  a  reduced  p.s.  R11'1  *  Because  X2,...,Xn  are  eigenvalues 

°f  L22>  verification  of  admissibility  of  L22Z  may  be  reduced 
similarly  as  above  to  verification  of  admissibility  of  a  linear  estimator 
in  a  model  with  R11  ^  *  l/n_2 •  Clearly,  continuing  this  reasoning  we  are 
finally  led  to  a  1  k  1  matrix  (X^),  where  Xn  e  [0,1],  And  XnZ, 
where  Z  is  a  random  variable  with  expectation  0  =  EZ  6  R  and 
covariance  a^I  =  cov  Z  £  R+,  is  admissible.  Thus,  the  original 
estimator  LY  is  admissible  as  asserted.  This  completes  the  proof. 
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